Accounting in an image transmission system based on a transmission mode and an accounting mode based on the transmission mode

ABSTRACT

There is disclosed an image transmission system for transmitting MPEG data through a transmission path, capable of setting frames for the MPEG data to be transmitted, according to the traffic in the transmission path, and effecting an accounting process with a charge system corresponding to thus set frames.

This application is a division of U.S. application Ser. No. 08/685,966,filed Jul. 22, 1996, now U.S. Pat. No. 5,909,238, issued Jun. 1, 1999.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to information providing in a multimedianetwork for transmitting various information such as moving image data,still image data, voice data, computer data etc., and an imagetransmission system corresponding to such information providing.

2. Related Background Art

In recent years, so-called information service industry is showingremarkable progress as a result of installation of the optical fibernetwork in the main communication networks, spreading of the cabletelevision systems, commercial exploitation of the satellitecommunication, popularization of local area networks. Such informationservice industry is to provide various information through such variouscommunication networks and to collect the charge according to thecontent and quantity of the provided information. In such informationservice industry, therefore, it is an important issue to effectappropriate charging, for the provided information.

However, the charging system conventionally employed in the informationservice industry has mostly been a monthly charging for charging a fixedcharge regardless of the frequency of use, such as in the cabletelevision systems or in the satellite broadcasting, or a chargingmethod only counting the frequency or time of use regardless of the kindor quality of the provided information, such as in the computerutilizing service.

SUMMARY OF THE INVENTION

In consideration of the foregoing, the object of the present inventionis to enable charging, in consideration of the kind of the informationor service and the quality of the information.

The above-mentioned object can be attained, according to an object ofthe present invention, by an image transmission system for transmittingMPEG data through a transmission path, capable of setting a frame of theMPEG data to be transmitted, according to the traffic of thetransmission path and effecting the charging according to a chargesystem corresponding to thus set frame.

According to another embodiment of the present invention, there isprovided an image transmission system for transmitting MPEG data betweena transmission terminal and a receiving terminal through a transmissionpath, comprising a receiving terminal including frame setting means forsetting a frame for the MPEG data to be transmitted, according to thetraffic of the transmission path, accounting process means for effectingan accounting process with a predetermined charging system, and atransmitting terminal including image charge information storing meansfor storing the charge information for the images to be used in theabove-mentioned accounting process.

Also according to still another embodiment of the present invention,there is provided an image transmission system for transmitting MPEGdata through a transmission path, comprising frame setting means forsetting a frame for the MPEG data to be transmitted, according to thetraffic of the transmission path, and accounting process means foreffecting an accounting process with a charge system according to theframes of the transmitted MPEG data and the amount of information.

Also according to still another embodiment of the present invention,there is provided an image transmission system for transmitting MPEGdata through a transmission path, comprising traffic check means forchecking the traffic of the transmission path, frame setting means forsetting a frame for the MPEG data to be transmitted, according to thetraffic of the transmission path, accounting process means for effectingan accounting process with a predetermined charge system, informationamount measuring means for measuring the amount of information of theimage transmitted through the transmission path, and image chargeinformation storage means for storing the charge information for theimage, to be used in the accounting process.

Also according to still another embodiment of the present invention,there is provided an image transmission system for transmitting MPEGdata through a transmission path, comprising traffic check means forchecking the traffic of the transmission path, frame setting means forsetting a frame for the MPEG data to be transmitted, according to thetraffic of the transmission path, accounting process means for effectingan accounting process with a charge system according to the frames andthe amount of information of the transmitted MPEG data, and image chargeinformation storage means for storing the charge information of theimage, to be used in the accounting process.

According to still another embodiment of the present invention, there isfurther provided charge paying means for paying the charge at apredetermined interval.

According to still another embodiment of the present invention, theabove-mentioned accounting process means is provided in the transmittingside.

Also according to still another embodiment of the present invention, theabove-mentioned accounting process means is provided in the receivingside.

Also according to still another embodiment of the present invention, theabove-mentioned accounting process means is provided both in thetransmitting side and in the receiving side.

Also according to still another embodiment of the present invention,there are provided image transmission destination designating means fordesignating an arbitrary image receiving apparatus for the destinationof image transmission and requesting the image transmission for an imageprovider, image transmission means for transmitting the image to theimage receiving apparatus designated by the image transmissiondestination designating means, and accounting process means foreffecting the charge accounting either to the designated destination ofthe image or to the user receiving the image.

Also according to still another embodiment of the present invention,there is provided cypher means for effecting at least encyphering ordigital signature to the transmitted information.

Owing to the technologies mentioned above, the embodiments of thepresent invention allow to set a frame for the MPEG data to betransmitted, according to the traffic of the transmission path, and toapply a charge for the image according to the content of thus set frame.

Also according to still another embodiment of the present invention, itis rendered possible to effect the accounting process with a chargesystem taking into consideration the amount of information of the imagein addition to the content of the transmitted frame.

Also according to still another embodiment of the present invention, itis rendered possible to effect payment of the charge at a predeterminedinterval.

Also according to still another embodiment of the present invention, itis rendered possible to protect the information from theft or illegalalteration and to effect fair accounting.

Another image transmission apparatus of the present invention, forhandling the MPEG data, is featured by comprising accounting means foreffecting an accounting process according to the kind of the transmittedframe among the MPEG data, and charge storage means for storing thecharge for the image.

Still another image transmission system of the present invention, forhandling MPEG data, is featured by comprising accounting means foreffecting an accounting process according to the kind of the transmittedframe.

Still another image transmission system of the present invention, forhandling MPEG data, is featured by comprising accounting means foreffecting an accounting process according to the kind and the amount ofinformation of the transmitted frame, among the MPEG data.

According to still another feature, there is provided an imagetransmission system for handling MPEG data, comprising accounting meansfor effecting an accounting process according to the kind of thetransmitted frame among the MPEG data, information amount measuringmeans for measuring the amount of information of the transmitted frame,and charge storage means for storing the charge for the image.

According to still another feature, there is provided an imagetransmission system for handling MPEG data, comprising accounting meansfor effecting an accounting process according to the kind and the amountof information of the transmitted frame among the MPEG data, and chargestorage means for storing the charge for the image.

According to still another feature, there is provided an imagetransmission system for handling MPEG data, comprising accounting meansfor effecting an accounting process according to the kind and the amountof information of the transmitted frame among the MPEG data, informationamount measuring means for measuring the amount of information of thetransmitted frame, and charge storage means for storing the charge forthe image.

According to still another embodiment of the present invention, there isprovided an image transmission system for handling MPEG data, comprisingaccounting means for transmitting all the frames of the MPEG data andeffecting an accounting process according to the kind of the framedecoded among the MPEG data.

Owing to the technologies mentioned above, the embodiments of thepresent invention allow to apply the charge for the image for each mode.

According to still another embodiment of the present invention, sincethe accounting is made according to the mode and the amount ofinformation of the image information, it is rendered possible to accountthe charge for the image for each mode and also in consideration of theamount of information.

According to still another embodiment of the present invention, there isprovided paying means for paying the charge at a predetermined interval,so that the charge accounting can be made at a predetermined period bycalculating the accumulated charge.

According to still another embodiment of the present invention, it isrendered possible to effect an accounting process according to the kindof the decoded frame among the transmitted MPEG data.

Still other objects of the present invention, and the features thereof,will become fully apparent from the following description which is to betaken in conjunction with the attached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram showing accounting process means ofa first embodiment;

FIG. 2 is a block diagram showing a specific example of theconfiguration of the accounting process means in the first embodiment;

FIG. 3 is a view showing an example of the charge table to be used bythe accounting process means of the first embodiment;

FIG. 4 is a schematic block diagram of the accounting process means in asecond embodiment;

FIG. 5 is a block diagram showing a specific example of theconfiguration of the accounting process means in the second embodiment;

FIG. 6 is a view showing an example of the charge table to be used bythe accounting process means of the second embodiment;

FIG. 7 is a schematic block diagram showing accounting process means ofa third embodiment;

FIG. 8 is a block diagram showing a specific example of theconfiguration of the accounting process means in the third embodiment;

FIGS. 9A and 9B are views showing examples of the charge table to beused by the accounting process means of the third embodiment;

FIG. 10 is a block diagram showing the basic configuration of an imagetransmission system in a fourth embodiment;

FIG. 11 is a view showing the function of the image transmission systemin the fourth embodiment;

FIG. 12 is a block diagram showing the basic configuration of an imagetransmission system in a fifth embodiment;

FIG. 13 is a view showing the function of the image transmission systemin the fifth embodiment;

FIG. 14 is a block diagram showing the basic configuration of an imagetransmission system in a sixth embodiment;

FIG. 15 is a view showing the function of the image transmission systemin the sixth embodiment;

FIG. 16 is a view showing a system in a seventh embodiment;

FIG. 17 is a view showing the accounting process in the system of theseventh embodiment;

FIG. 18 is a view showing a system in an eighth embodiment;

FIG. 19 is a view showing the accounting process in the system of theeighth embodiment;

FIG. 20 is a view showing the frame configuration in the MPEG data;

FIG. 21 is a view schematically showing the format of the MPEG encodedimage data; and

FIG. 22 is a view showing a key sequence in encyphering MPEG data.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Now the image transmission system of the present invention will beclarified in detail by preferred embodiments thereof, with reference tothe attached drawings.

Following embodiments are applied to a transmission system fortransmitting MPEG data through a transmission path, for enabling, inconsideration of the feature of the MPEG data, to set a frame for theMPEG data to be transmitted according to the traffic of the transmissionpath and to a charge for the image according to the above-mentionedframe.

Particularly in a first embodiment, there will be explained accountingprocess means for effecting an accounting process with a charging systemin which charges are determined respectively for a case of transmittingan I frame only, a case of transmitting an I frame and a P frame, and acase of transmitting an I frame, a P frame and a B frame.

In a second embodiment, there will be explained the accounting processmeans with a charge system in consideration of the amount of informationof the image, in addition to the case of transmitting an I frame only,an I frame and a P frame, and an I frame, a P frame and a B frame.

In a third embodiment, there will be explained the accounting processmeans for accounting the charge at a predetermined interval in the firstand second embodiments.

In a fourth embodiment, there will be explained a configuration in whichthe accounting process means in the first to third embodiments isprovided in the image providing side.

In a fifth embodiment, there will be explained a configuration in whichthe accounting process means in the first to third embodiments isprovided in the image receiving side.

In a sixth embodiment, there will be explained a configuration in whichthe accounting process means in the first to third embodiments isprovided both in the image providing side and in the image receivingside.

In a seventh embodiment, there will be explained a configuration inwhich the accounting process means in the foregoing first to sixthembodiments is applied to the communication between equipment connectedto a local area network.

In an eighth embodiment, there will be explained a configuration inwhich the accounting process means in the foregoing first to sixthembodiments is applied to the communication between equipment connectedto a wide area network.

In a ninth embodiment, there will be explained a configuration in whichcypher means is combined with the accounting process means shown in theforegoing fourth to eighth embodiments, for protecting the informationfrom theft or illegal alteration and realizing fair accounting.

In a tenth embodiment, there will be explained accounting process meanswith a charge system in which charges are determined respectively for acase of transmitting all the MPEG data for an image and decoding an Iframe only, a case of decoding an I frame and a P frame, and a case ofdecoding an I frame, a P frame and a B frame.

In an eleventh embodiment, there will be explained a configuration inwhich cypher means is combined with the accounting process means in theforegoing first to tenth embodiments, for protecting the informationfrom theft or illegal alteration and realizing fair accounting.

In the following there will be explained the first embodiment of thepresent invention, with reference to the attached-drawings. Prior to thedetailed description of the first embodiment, there will be given anexplanation on the MPEG (Moving picture experts group) method employedfor encoding for efficient storage and transmission of the movingpicture information.

The MPEG is an international standard designed for highly efficientencoding of the moving image and achieves a high efficiency in theencoding utilizing the frequency characteristics of the data and thevisual characteristics of human being, and also the redundancy in thetime axis, specific to the moving image.

In the MPEG system, there are known MPEG1 with a maximum transfer rateof 1.5 Mbps for the digital storage media, and MPEG2 designed for useall the transmission systems such as the bidirectional multimediaequipment, digital VCR, advanced television, optical fiber network etc.without the upper limit in the transfer rate, but the basic algorithm isalmost same for the both. In the following, therefore, there will beexplained the encoding principle and the data structure, principallytaking the MPEG1 as an example.

At first there will be explained the principle of highly efficiencyencoding by the MPEG system. In this encoding system, a high efficiencyin the encoding can be realized by calculating the difference betweenthe frames, thereby reducing the redundancy in the direction of timeaxis, and effecting DCT and variable-length encoding on thus obtaineddifference data, thereby reducing the redundancy in the spatialdirection.

The above-mentioned redundancy in the time axis can be reduced, inconsideration of the high correlation among the continuous frames in themoving image, by calculating the difference between the frame to beencoded and a preceding or succeeding frame.

In the MPEG system, therefore, there are provided, as shown in FIG. 20,in addition to an intra-encoded picture obtained by an encoding mode ofeffecting the encoding within a frame, a preceding prediction encodedimage (P-picture) obtained by encoding the difference from a framepreceding in time, and a bidirectional prediction encoded image(B-picture) obtained by encoding the one with the least data amountamong the difference from a frame preceding in time, that from a framesucceeding in time and that from an interpolated frame of theabove-mentioned two frames, and the frames obtained by such encodingmodes are combined in a predetermined sequence.

In the MPEG system, a unit or a GOP (group of pictures) is composed ofan I-picture, 4 P-pictures and 10 B-pictures, and there is recommended acombination of the I-picture at first, followed by repetition of twoB-pictures and a certain number of P-pictures. The I-pictures isprovided at a predetermined interval to enable special reproduction suchas reverse reproduction and a partial reproduction utilizing theabove-mentioned GOP as a unit, and also to prevent the propagation ofthe error.

In case a new object appears in the frame, the difference from thesucceeding frame may become smaller than that from the preceding frame.For this reason, the MPEG system effects the above-explainedbidirectional prediction encoding to achieve a higher efficiency in theencoding.

Also the MPEG system effects movement compensation by calculating thedifference between a predetermined block (macroblock) containing 4blocks of 8×8 pixels each for the luminance data and 2 blocks for thecolor difference signals, and a macroblock in the vicinity of thecorresponding block in the preceding or succeeding frame, then detectinga movement vector by searching a macroblock showing the leastdifference, and encoding such movement vector as data.

At the decoding operation, this movement vector is used for extractingthe data of the corresponding macroblock in the preceding or succeedingframe, and such extracted data are used in decoding the data encodedwith movement compensation.

In such movement compensation, the frame preceding in time is onceencoded and decoded to obtain the preceding frame, and the movementcompensation is achieved by the macroblock in such preceding frame andthat of the frame to be encoded.

The movement compensation in the MPEG1 is conducted between the frames,but that in the MPEG2 is conducted between the fields.

The difference data and the movement vector obtained by such movementcompensation are further subjected to highly efficient encoding by theDCT transformation and the Huffman encoding.

In the following there will be explained the data structure of the MPEGsystem.

The MPEG data have a hierarchic structure consisting, as shown in FIG.21, of a video sequence layer, a GOP layer, a picture layer, a slicelayer, a macroblock layer and a block layer.

These layers will be explained in the following, starting from thelowermost one.

The block layer is composed, as in the JPEG system, of blocks, eachconsisting of 8×8 pixels for the luminance data and the color differencedata, and the DCT transformation is conducted in the unit of each block.

The macroblock layer is composed of macroblocks, each consisting of 4blocks of 8×8 pixels each for the luminance data and 1 block for eachcolor data, associated with a microblock header. In the MPEG system,this macroblock is used as the unit for the movement compensation andthe encoding, as will be explained later.

The above-mentioned macroblock header contains data of the movementcompensation and the digitizing step in each macroblock unit, and dataindicating whether the six DCT blocks (Y0, Y1, Y2, Y3, Cr, Cb) in eachmacroblock contain data.

The slice layer is composed of one or more macroblocks consecutivelyarranged in the order of image scanning, and a slice header, and samequantizing steps can be employed for the macroblocks within the sameslice layer.

The above-mentioned slice header contains data relating to thequantizing steps within each slice layer, and same quantizing steps areapplied within the same slice layer unless quantizing steps are providedspecific to each macroblock. The first macroblock resets the differencefor the DC component.

The picture layer contains a plurality of the slice layers in the unitof a frame, and is composed of a header containing a picture start codeetc. and one or more slice layers. The above-mentioned header contains acode indicating the image encoding mode and a code indicating theprecision (in the unit of a pixel or a half pixel) of the movementdetection.

The GOP layer is composed of a header including for example a groupstart code and a time code indicating the time from the start ofsequence, and a plurality of I-, B- and P-frames.

The video sequence layer starts with a sequence start code and ends witha sequence end code, between which arranged are control data requiredfor the decoding of the image size and the aspect ratio, and a pluralityof GOP of a same image size. In the MPEG system of such data structure,the bit stream is defined by the standard thereof. Such encodingtechnology is already well known in the multimedia networks.

In the MPEG system, as explained in the foregoing, the I-framerepresents the approximate movement of the moving image independentlyfrom the P- or B-frame, while the P-frame, when decoded in combinationwith the I-frame, reproduces the smoother movement of the moving image.Also the B-frame, when decoded in combination with the I- and P-frames,allows to reproduce further smoother movement.

In consideration of such features, the MPEG system can be considered anencoding system that deals with the image movement in hierarchic manner.The required transmission capacity is larger for the transmission of theI- and P-frames than for the transmission of the I-frame only, and evenlarger for the transmission of the I-, P- and B-frames.

Therefore, for transmitting the MPEG data, there can be conceived atransmission method of at first effecting the MPEG encoding for theimage to be transmitted, then inspecting the state of use of thetransmission path, and, if there is a sufficient available capacity,transmitting all the frames of the image information.

If the available capacity is not sufficient for transmitting all theframes, the I- and P-frames alone are transmitted. If the availablecapacity is even lower, the I-frame alone is transmitted. Suchtransmission technology is an important component technology in dealingwith the multimedia data in the LAN (local area network) etc.

The present embodiment is applied to an image transmission system fortransmitting the MPEG data through a transmission path, for selectingthe-frames of the MPEG data to be transmitted, in consideration of thefeature of the MPEG data and according to the traffic in thetransmission path, and for realizing accounting process means foreffecting an accounting process with a charge system determinedcorresponding to the transmitted frames for each image.

In the present embodiment, the MPEG data transmission mode is defined asa mode 1 in case of transmitting the I-frame only, a mode 2 in case oftransmitting the I- and P-frames, and a mode 3 in case of transmittingthe I-, P- and B-frames.

FIG. 1 is a functional block diagram showing the principal parts ofaccounting process means in the image transmission system of the presentinvention, wherein accounting process means 100 is provided in the imagetransmission system. A control unit 101 fetches a request for imagetransmission from the user, transmitted in the image transmissionsystem, accordingly controls a traffic check unit 102, a transmissionmode selection unit 103 and an accounting unit 104, and informs thetransmission mode selection unit 103 and the accounting unit 104 of animage identifier (name or code for identifying the image) requestedtherefrom.

A traffic check unit 102 checks the currently available transmissioncapacity (traffic information) by monitoring the image transmissionsystem 110 (or transmission path) or inquiring the image transmissionsystem 110 of the information on the traffic status managed therein, andinforms the transmission mode selection unit 103 of the result of suchcheck.

A transmission mode selection unit 103 receives the identifier of therequested image from the control unit 101 and the traffic information ofthe image transmission system from the traffic check unit 102, selects atransmission mode for the image transmission according to the trafficinformation, and informs the accounting unit 104 and the imagetransmission system 110 of such transmission mode.

An accounting unit 104 fetches the image identifier from the controlunit 101 and the transmission mode information from the transmissionmode selection unit 103, reads a charge corresponding to such fetchedinformation from a storage unit 105 and informs the image transmissionsystem 110 of such charge.

A storage unit 105 stores the charge information of the image, to bereferred to by the accounting unit 104.

An image transmission system 110 is composed of a network and terminalsconnected thereto with wires or with wireless connections, such ascomputers, receivers, printers, monitors etc. It is to be noted that theabove-explained functions need not necessarily be divided in theabove-explained manner, and the plural functional blocks may be unitedin a functional block, or there may be provided plural blocks for any ofthe foregoing functions.

In the following there will be explained an example of the trafficchecking method in the traffic check unit 102, in case the imagetransmission system 110 is realized with the ATM (asynchronous transfermode).

The traffic check unit 102 inquires the image transmission system 110whether the transmission is possible with a certain transfer rate Cr. Ifthe image transmission system 110 does not permit the transmission withsuch transfer rate Cr, the enquiry to the image transmission system 110for a transfer rate C′r smaller than Cr until the permission is given.On the other hand, if the image transmission system 110 permits thetransmission with the transfer rate Cr, it is set as the check value.

However, in the image transmission system constructed with other networksystems, there may be employed other traffic checking methodscorresponding to such network systems. Thus the traffic checking methodof the present embodiment is not limited to the above-explained case ofthe ATM.

In the following there will be explained an example of the transmissionmode selecting method in the transmission mode selection unit 103.

At first the transmission mode selection unit 103 receives theinformation on the traffic status of the image transmission system 110from the traffic check unit 102, and also receives the identifier of therequested image from the control unit 101.

Then it compares the transmission capacity required for transmitting therequested image in each transmission mode with the traffic (availabletransmission capacity) of the image transmission system, by makingaccess to the storage unit 105 (of which stored information will beexplained later with reference to FIG. 3), and determines thetransmission mode for the image transmission in the following manner.

For the available transmission capacity Cr determined by the trafficcheck unit 102 and for the transmission capacities C1, C2, C3 requiredfor transmitting certain MPEG data respectively in the transmissionmodes 1, 2 and 3, the transmission mode 3 is selected if Cr≦C3.

Also the transmission mode 2 is selected in case C3>Cr≧C2, and thetransmission mode 1 is selected in case C2>Cr≧C1. In case of C1>Cr, theimage transmission system is informed of a fact that an enoughtransmission capacity cannot be obtained even in the transmission mode1.

However, the function of the transmission mode selection unit 103 is notlimited to the one explained above. For example it may execute the imagetransmission with a transmission mode i (i=1, 2, . . . ) for thetransmission capacity Cr, even in case Cr is insufficient for the imagetransmission with such mode i (Cr<Ci) or it may wait until a sufficientcapacity Cr (≧Ci) can be obtained.

FIG. 3 shows an example of the charge table stored in the storage unit105. FIG. 3, indicates, example, the information Info 1 corresponds to acharge 11 in case it is provided with the transmission mode 1 andrequires in such case a transmission capacity C11.

The table also indicates that the same information corresponds to acharge 12 when provided in the transmission mode 2 and requires atransmission capacity C12, and that the same information corresponds toa charge 13 when provided in the transmission mode 3 and requires atransmission capacity C13.

In the following there will be explained the function of the accountingprocess means of the present embodiment with the charge systemdetermined for each transmission mode, in case a user (or a terminal ofthe user) requests an image Info 1 from the provider in a state wherethe image transmission system has an available transmission capacity Cr(C13>Cr≧C12).

In a first operation sequence, the control unit 101 fetches informationthat the user requests the transmission of the image Info 1, bymonitoring the messages exchanged in the image transmission system or byreceiving a message therefrom.

Then, in a second operation sequence, the traffic check unit 102 checksthe current traffic status of the image transmission system 110, therebyobtaining the available transmission capacity Cr.

Then, in a third operation sequence, the control unit 101 informs thetransmission mode selection unit 103 of the identifier of the requestedimage Info 1. Also the traffic check unit 102 informs the transmissionmode selection unit 103 of the above-mentioned available transmissioncapacity Cr. Also the transmission mode selection unit 103 reads, fromthe storage unit 105, the transmission capacities required fortransmitting the image Info 1 with the transmission modes, then comparesthese transmission capacities with the above-mentioned availabletransmission capacity thereby determining the transmission mode 2corresponding to the traffic status, and informs the image transmissionsystem 110 of the transmission mode.

Then, in a fourth operation sequence, the control unit 101 informs theaccounting unit 104 of the identifier of the requested image Info 1, andthe transmission mode selection unit 103 informs the accounting unit 104of the selected transmission mode 2.

The accounting unit 104 reads, from the charge table stored in thestorage unit 105 as shown in FIG. 3, the charge 12 corresponding to theimage identifier Info 1 informed from the control unit 101 and thetransmission mode 2 informed from the transmission mode selection unit103 and informs the charge to the image transmission system 110.

FIG. 2 is a block diagram showing a specific example of theconfiguration of the accounting process means 100 shown in FIG. 1.

Referring to FIG. 2, accounting process means 200 corresponds to themeans 100 in FIG. 1. A CPU 201 processes an input from an I/O interface202 and sends instructions to the external units according to a programstored in a ROM 204 or a RAM 203.

An I/O interface 202 is used for exchanging information with the imagetransmission system and for input/output with a storage device 206. ARAM 203 is used as a temporary memory for the CPU 201 and for programstorage.

A ROM 204 stores the program to be executed by the CPU 201. It mayhowever be dispensed with in case the program is read from the outsideof the accounting process means 200 or is stored in the RAM 203.

A bus 205 is used for data exchange of the CPU 201—ROM 204. A storagedevice 206, for storing the charges for the respectively transmissionmodes for each image, can be composed, for example, of a magneticmedium, an optical medium or a semiconductor device.

The functions of the control unit 101, the traffic check unit 102, thetransmission mode selection unit 103 and the accounting unit 104 shownin FIG. 1 can be realized, in the configuration shown in FIG. 2, by theCPU 201, the I/O interface 202, the RAM 203, the ROM 204 and the bus205.

For example, the control of the aforementioned operation sequences, thetraffic checking, the transmission mode selection and the accountingprocess are executed by the CPU 201, and the sequences and methodstherefore are stored in the RAM 203 or the ROM 204. The traffic checkingin the first operation sequence, the informing of the transmission modein the second operation sequence, and the informing of the charge in thefourth operation sequence are executed through the I/O interface 202.

However the configuration realizing the functional blocks shown in FIG.1 is not limited to that shown in FIG. 2, and it is also possible toconstruct a part or all of the functional blocks shown in FIG. 1 into asingle device. Also the operations are not limited to those explained inthe foregoing, but the following operations are also included in thepresent embodiment.

For example the second and third operation sequences are united into asingle sequence, and the transmission mode selection unit 103 reads thetransmission capacity Ci required for transmitting the Info 1 with atransmission mode i. This transmission capacity Ci is informed to thetraffic check unit, which then inspects whether the transmission can bemade with such transmission mode i.

If the transmission is not possible, the transmission mode selectionunit 103 reads the transmission capacity required in a lowertransmission mode (for example mode i-1). This operation is repeated,and, when the transmission is identified possible, the transmission modeselection unit informs the image transmission system and the accountingunit of thus identified transmission mode.

Otherwise, in the first operation sequence, the user designates thetransmission mode at the request for image, and, if the image can betransmitted in the designated transmission mode in the second to fourthoperation sequences, the transmission mode selection unit 103 sends aninstruction to transmit the data with the designated mode to the imagetransmission system, and the accounting unit 104 executes the accountingprocess in such transmission mode.

In case the transmission is not possible, the transmission modeselection unit 103 either effects transmission with an available rate,or waits until the transmission becomes possible. Otherwise it informsthe image transmission system of a process of transmission with alowered transmission mode or of cancelling the request. The accountingunit 104 effects an accounting process according to such process.

In the following there will be explained a second embodiment of thepresent invention, with reference to the attached drawings.

The present embodiment is applied to an image transmission system fortransmitting the MPEG data through a transmission path, for selectingthe frames of the MPEG data to be transmitted in consideration of thefeature of the MPEG data and according to the traffic in thetransmission path, also for determining a unit charge per unit amount ofinformation according to the frames transmitted for each image, and forrealizing accounting process means with a charge system for determiningthe charge based on such unit charge and the amount of information ofthe transmitted image.

In the present embodiment, the MPEG data transmission mode is defined asa mode 1 in case of transmitting the I-frame only, a mode 2 in case oftransmitting the I- and P-frames, and a mode 3 in case of transmittingthe I-, P- and B-frames. In the following description, the explanationwill be principally given to the parts different from those alreadyexplained in the foregoing drawings, and the explanation will not begiven to the parts which are substantially same as those alreadyexplained.

FIG. 4 is a functional block diagram showing the principal parts ofaccounting process means in the image transmission system of the presentinvention, and corresponds to FIG. 1 in the first embodiment.

Accounting process means 400 is provided in the image transmissionsystem, corresponding to the accounting process means 100 in FIG. 1.

There are also provided a control unit 401 corresponding to the controlunit 101 in FIG. 1; a traffic check unit 402 corresponding to thetraffic check unit 102 in FIG. 1; a transmission mode selection unit 403corresponding to the transmission mode selection unit 103 in FIG. 1; anaccounting unit 404 corresponding to the accounting unit 104 in FIG. 1;a storage unit 405 for storing the charge information of the image to bereferred to by the control unit 401, and corresponding to the storageunit 105 in FIG. 1; and an image transmission system 410 correspondingto the image transmission system 110 in FIG. 1.

A measuring unit 406, absent in the foregoing first embodiment, isprovided for measuring the amount of the image information transmittedor received by the image transmission system 410.

FIG. 6 shows an example of the charge table stored in the storage unit402. FIG. 6 indicates, for example, the information Info 1 correspondsto a charge 11 per unit information amount when provided in thetransmission mode 1, or a charge 12 per unit information amount whenprovided in the mode 2, or a charge 13 when provided in the mode 3.

In the following there will be explained the function of the accountingprocess means of the present embodiment with the charge system ofdetermining a charge per unit information amount for each transmissionmode and determining the charge based on the unit information amount andthe amount of information of the image, in case a user (or a terminal ofthe user) requests an image Info 1 from the provider in a state wherethe image transmission system has an available transmission capacity Cr(C13>Cr≧C12). In the following description, the first to fourthoperation sequences will be omitted as they are same as those in thefirst embodiment.

In the present embodiment, after the fourth operation sequence explainedin the foregoing, in a fifth operation sequence, the measuring unit 406counts the amount of the information Info 1 during the transmissionthereof in the image transmission system 410, and, after thetransmission of the Info 1, the accounting unit 404 determines thecharge based on the unit charge 12 and the counted information amountand informs the image transmission system 410 of such determined charge.

FIG. 5 is a block diagram showing a specific example of theconfiguration of the accounting process means 400 shown in FIG. 4.

In FIG. 5, there are provided accounting process means 500 correspondingto that 200 in FIG. 2; a CPU 501 corresponding to that 201 in FIG. 2; anI/O interface 502 corresponding to that 202 in FIG. 2; a RAM 503corresponding to that 203 in FIG. 2; a ROM 504 corresponding to that 204in FIG. 2; a bus 505 for data exchange by the CPU 501—ROM 504,corresponding to the bus 205 in FIG. 2; and a storage device 506 forstoring the charge for the image for each transmission mode,corresponding to that 206 in FIG. 2. The functions of the control unit401, the traffic check unit 402, the transmission mode selection unit403 and the accounting unit 404 shown in FIG. 4 can be realized, in theconfiguration shown in FIG. 5, by the CPU 501, the I/O interface 502,the RAM 503, the ROM 504, the bus 505 and the measuring device 507(however the measuring device 507 may be dispensed with in case of timemeasurement).

This is same as in the first embodiment. In the present embodiment, atan arbitrary timing in the course of image transmission, the charge atsuch timing is determined by a method as in the fifth operationsequence, and the accounting unit 404 informs the image transmissionsystem of such charge.

In the following there will be explained a third embodiment of thepresent invention, with reference to the attached drawings.

The present embodiment is applied, in the foregoing first and secondembodiments, to enable the accounting of the charge at a predeterminedinterval, by calculating the cumulative charge.

In the present embodiment, the MPEG data transmission mode is defined asa mode 1 in case of transmitting the I-frame only, a mode 2 in case oftransmitting the I- and P-frames, and a mode 3 in case of transmittingthe I-, P- and B-frames.

FIG. 7 is a functional block diagram showing the accounting processmeans in the third embodiment, wherein provided are a control unit 701corresponding to that 401 in FIG. 1; a traffic check unit 702corresponding to that 402 in FIG. 4; a transmission mode selection unit703 corresponding to that 403 in FIG. 4; an accounting unit 704corresponding to that 404 in FIG. 4; a storage unit 705 corresponding tothat 405 in FIG. 4; and a measuring unit 706 corresponding to that 406in FIG. 4.

FIGS. 9A and 9B illustrate examples of an accumulated charge tablestored in the storage unit 705. FIG. 9A shows the accumulated chargetable in case the accounting process means 700 is provided at a terminalof the image provider side. The table shown in FIG. 9A indicates that,among the charges for the images provided to a user A, a charge A alonestill remains unaccounted, and that, among the charges for the imagesprovided to a user B, a charge B alone still remains unaccounted.

Also FIG. 9B shows the accumulated charge table in case the accountingprocess means is provided in a terminal at the user side. The tableshown in FIG. 9B indicates that, among the charges for the imagesprovided by a provider A, a charge A alone still remains unaccounted andthat, among the charges for the images provided by a provider B, acharge B alone still remains unaccounted.

In the following there will be explained the sequence, executed by theaccounting process means of the present embodiment, for determining thecumulative sum of the charges determined from the unit charge and theamount of image information, in case a user L (or a terminal of theuser) requests an image Info 1 from a provider A in a state where theimage transmission system has an available transmission capacity Cr(C13>Cr≧C12).

In the following description, the first to fifth operation sequenceswill be omitted as they are same as those explained in the foregoing.

In the present embodiment, in a sixth operation sequence after the endof the fifth operation sequence, the accounting unit 704 reads theaccumulated charge for the user L from the storage unit 705, then addsthe charge determined in the fifth operation sequence to the accumulatedcharge and stores the sum in the storage unit 705.

FIG. 8 is a block diagram showing a specific example of theconfiguration of the accounting means corresponding to FIG. 7.

In FIG. 8 there are provided accounting process means 800 correspondingto that 500 in FIG. 5; a CPU 801 corresponding to that 501 in FIG. 5; anI/O interface 802 corresponding to that 502 in FIG. 5; a RAM 803corresponding to that 502 in FIG. 5; a ROM 804 corresponding to that 504in FIG. 5; a bus 805 for data exchange in the CPU 801—ROM 804,corresponding to the bus 505 in FIG. 5; and a storage device 806 forstoring the charges for the respective transmission modes for eachimage, corresponding to the storage device 506 in FIG. 5.

The functions of the control unit 701, the traffic check unit 702, thetransmission mode selection unit 703 and the accounting unit 704 shownin FIG. 7 can be realized, in the configuration shown in FIG. 8, by theCPU 801, the I/O interface 802, the RAM 803, the ROM 804, the bus 805and the measuring device 807 (however the measuring device 807 may bedispensed with in case of time measurement).

This is same as in the first embodiment. In the present embodiment, atan arbitrary timing in the course of image transmission, the charge atsuch timing is determined by a method as in the fifth operationsequence, and the accounting unit 704 informs the image transmissionsystem of such charge.

In the present embodiment, the charge table is changed from the oneshown in FIG. 6 to the one in FIG. 3. Then, in the fourth operationsequence, the uniform charge for each image (charge 13) is read insteadof the unit charge. Then the counting of the information amount is notconducted in the fifth operation sequence, and, in the sixth operationsequence, the sum of the accumulated charge read in the fourth operationsequence and the charge 13 is set as a new accumulated charge.

Then, at an arbitrary timing in the course of image transmission, thecharge at such timing is determined by a method as in the fifthoperation sequence, and the accounting unit 704 informs the imagetransmission system of such charge.

Also the sixth operation sequence is conducted parallel to the fourthand fifth operation sequences. The fifth operation sequence does notinform the charge, and the sixth operation sequence informs theaccumulated charge.

In the following there will be explained a fourth embodiment of thepresent invention, with reference to the attached drawings.

FIG. 10 is a block diagram where the accounting process means in thefirst to third embodiments is provided at the side of the image provider(or the terminal thereof).

In the present embodiment, the MPEG data transmission mode is defined asa mode 1 in case of transmitting the I-frame only, a mode 2 in case oftransmitting the I- and P-frames, and a mode 3 in case of transmittingthe I-, P- and B-frames.

In FIG. 10, a transmission terminal 1001 is composed for example of apersonal computer, a work station, a computer or an image transmitter ofthe image provider side, provided with the accounting process means.

There are also shown accounting process means 1002 shown in theforegoing first to third embodiments, and a receiving terminal 1003composed for example of a personal computer, a work station, a computeror an image receiver of the user side.

In the following there will be explained, with reference to FIG. 11, thefunction of the present embodiment employing the accounting processmeans of the second embodiment and the apparatus therefor, in case auser L (receiving terminal 1003) requests an image Info 1 to a provider(transmitting terminal 1001) in a state where the image transmissionsystem has an available transmission capacity Cr (C13>Cr≧C12).

At first, in a first operation sequence, the user L sends a message(image transmission requesting message) requesting the image Info 1 tothe provider A through the transmission path. Upon reception of thismessage in the terminal 1001 of the provider A, the accounting processmeans 1002 fetches the message from the transmission terminal 1001.

Then, in a second operation sequence, the accounting process means 1002inspects the traffic of the transmission path through the transmissionterminal 1001 to obtain the available transmission capacity Cr, thencompares the available transmission capacity Cr with C11—C13 byreferring to the charge table shown in FIG. 6, thereby determining thetransmission mode 2 for the transmission of the Info 1 and informs thetransmission terminal 1001 of such transmission mode 2.

Then, in a third operation sequence, the transmission terminal 1001transmits the Info 1 to the user L in the mode 2, through thetransmission path. At the same time, the accounting process means 1002measures the amount of information of the Info 1 transmitted by thetransmission terminal 1001.

In a fourth operation sequence, the accounting process means 1002monitors the Info 1 under transmission, and, upon confirming the end oftransmission of the Info 1 either by detecting a bit pattern indicatingthe end of the image or by receiving a message from the transmissionterminal 1001 to the user L, indicating the end of transmission of theInfo 1, reads the unit charge 12 from the charge table shown in FIG. 6and determines the charge to the user L, based on the amount ofinformation of the Info 1 provided to the user L and the unit charge 12.

Then, in a fifth operation sequence, the accounting process means 1002sends the charge, determined in the fourth operation sequence, to thetransmission terminal 1001.

In a sixth operation sequence, the charge payment is executed.

The following operations are also included in the present embodiment.

At first, in the first operation sequence, the user also designates thetransmission mode, at the request of the image. If the transmissioncapacity Cr enough for the transmission with the designated transmissionmode cannot be obtained, the accounting process means either effectstransmission with the designated transmission mode and with thetransmission capacity Cr, or waits until a sufficient transmissioncapacity is obtained, or effects transmission with a transmission modepermitted within the transmission capacity Cr.

Otherwise it sends, to the image transmission apparatus, an instructionfor example of cancelling the request and effects an accounting processcorresponding to such instruction. At the same time the imagetransmitting apparatus effects a process of image transmission orrequest cancellation with the image receiving apparatus. Theabove-mentioned process options may be asked to and selected by theuser.

In another operation mode, at the first operation sequence, the useralso designates a terminal (or an image processing apparatus) as thedestination of the image, at the request for the image to the imageprovider, and the provider A transmits the image information to thusdesignated destination.

In the third operation sequence, the unit charge 12 is read and thecharge to such timing is calculated from the unit charge 12 and theamount of information up to such timing. Then the calculated charge issent to the transmission terminal 1001 for information to the provider Aand the user L.

In the fourth operation sequence, the read unit charge 12 is supplied tothe transmission terminal 1001 which further transmits the unit charge12 to the user L through the transmission path.

Then, in the fifth operation sequence, the transmission terminal 1001informs the user L of the above-mentioned charge through thetransmission path.

The accounting process means 1002 is realized by the CPU, memory,storage device etc. provided in the transmission terminal 1001.

In addition to the foregoing examples, the present embodiment alsoincludes such variations as the application of the accounting processmeans of the first or third embodiment.

In the following there will be explained a fifth embodiment of thepresent invention, with reference to the attached drawings.

FIG. 12 is a block diagram where the accounting process means in thefirst to third embodiments is provided at the side of the user (or theterminal thereof).

In the present embodiment, the MPEG data transmission mode is defined asa mode 1 in case of transmitting the I-frame only, a mode 2 in case oftransmitting the I- and P-frames, and a mode 3 in case of transmittingthe I-, P- and B-frames.

In FIG. 12, there are shown a transmission terminal 1201 composed forexample of a personal computer, a work station, a computer or an imagetransmitter of the image provider side, provided with the accountingprocess means; accounting process means 1202 shown in the foregoingfirst to third embodiments; and a receiving terminal 1203 composed forexample of a personal computer, a work station, a computer or an imagereceiver of the user side.

In the following there will be explained, with reference to FIG. 13, thefunction of the present embodiment employing the accounting processmeans of the second embodiment, in case a user L (receiving terminal1203) requests an image Info 1 to a provider A (transmission terminal1201) in a state where the image transmission system has an availabletransmission capacity Cr (C13>Cr≧C12).

At first, in a first operation sequence [S1], the user L generates,within the receiving terminal 1203, a message requesting thetransmission of the image Info 1 to the provider A (image transmissionrequesting message). The accounting process means 1202 fetches thismessage from the receiving terminal 1203.

Then, in a second operation sequence [S2], the accounting process means1202 inspects the traffic of the transmission path through the receivingterminal 1203 to obtain the available transmission capacity Cr, thencompares the available transmission capacity Cr with C11 to C13 byreferring to the charge table shown in FIG. 6, thereby determining thetransmission mode 2 for the transmission of the Info 1 and informs thereceiving terminal 1203 of such transmission mode 2.

The receiving terminal 1203 informs the transmission terminal 1201,through the transmission path, of a fact that “the user L requests thetransmission of the image Info 1 in the transmission mode 2 to theprovider A”.

Then, in a third operation sequence [S3], in response to the informingfrom the receiving terminal 1203, the transmission terminal 1201transmits the Info 1 to the user L through the transmission path, in thetransmission mode 2. At the same time the accounting process means 1202measures the amount of information of the Info 1 received by thereceiving terminal 1203.

Then, in a fourth operation sequence [S4], the accounting process means1202 monitors the Info 1 under reception, and confirms the end oftransmission of the Info 1 either by detecting a bit pattern indicatingthe end of the image or by receiving a message from the receivingterminal 1203 indicating the end of reception of the Info 1 from theprovider A.

Upon confirming the end of reception in the above-explained manner, theaccounting process means 1202 reads the unit charge 12 from the chargetable shown in FIG. 6, then determines the charge to be charged by theprovider A, based on the amount of information of the Info 1 receivedfrom the provider A and the unit charge 12, and transmits such charge tothe receiving terminal 1203.

In a fifth operation sequence [S5], the charge payment is executed.

The following case is also included in the present embodiment.

At first, in the first operation sequence, the user also designates thetransmission mode, at the request of the image.

If the transmission capacity Cr enough for the transmission with thedesignated transmission mode cannot be obtained, the accounting processmeans 1202 effects transmission with the designated transmission modeand with the available transmission capacity Cr, or waits until asufficient transmission capacity is obtained, or effects transmissionwith a transmission mode permitted-within the transmission capacity Cr.

Otherwise it sends, to the image receiving apparatus, an instruction forexample of cancelling the request and effects an accounting processcorresponding to such instruction. At the same time the image receivingapparatus effects a process of image transmission or requestscancellation in cooperation with the image transmission apparatus.

The above-mentioned process options may be asked to and selected by theuser.

In another operation mode, at the first operation sequence, the useralso designates a terminal (or an image processing apparatus) as thedestination of the image, at the request for the image to the imageprovider, and the image provider A transmits the image information tothus designated destination. This operation includes following twocases.

In a first case, the accounting process means belongs to the user. Inthis case, the user (or the accounting process means thereof) receives anotice indicating the start of image transmission from the destinationor the image provider, at the start of image providing prior to thethird operation sequence, and initiates the accounting process.

Also in the fourth operation sequence, the accounting operation isterminated in response to a notice indicating the end of imagetransmission. Also the amount of image information is informed to theuser from the destination or the image provider.

In a second case, the accounting process means belongs to thedestination designated by the user. In this case, the user sends, in thefirst operation sequence, the image transmission requesting message alsoto the destination, of which accounting process means fetches thismessage. The accounting process means of the destination informs theprovider or the user of the charge in the fourth operation sequence.

In the first operation sequence, the receiving terminal 1203 transmitsthe image transmission requesting message, and the transmission terminal1201 selects the transmission mode 2 in the same manner as in theaccounting process means 1202.

In the third operation sequence, the unit charge 12 is read, then thecharge to such timing is calculated, based on the unit charge 12 and theamount of information Info 1 received up to such timing, and thuscalculated charge is supplied to and displayed on the receiving terminal1203, as information to the user L.

In addition, the present embodiment also includes such variations asrealizing the accounting process means 1202 by means of the CPU, memory,storage device etc. provided in the receiving terminal 1203, or asapplying the accounting process means of the first or third embodiment.

In the following there will be explained a sixth embodiment of thepresent invention, with reference to the attached drawings.

FIG. 14 is a block diagram where the accounting process means in thefirst to third embodiments is provided both at the image provider (orthe terminal thereof) and at the user (or the terminal thereof).

In the present embodiment, the MPEG data transmission mode is defined asa mode 1 in case of transmitting the I-frame only, a mode 2 in case oftransmitting the I- and P-frames, and a mode 3 in case of transmittingthe I-, P- and B-frames.

In FIG. 14, there are shown a transmission terminal 1401 composed forexample of a personal computer, a work station, a computer or an imagetransmitter of the image provider side, provided with the accountingprocess means; accounting process means 1402 shown in the foregoingfirst to third embodiments; a receiving terminal 1403 composed forexample of a personal computer, a work station, a computer or an imagereceiver of the user side provided with the accounting process means;and accounting process means 1404 shown in the foregoing first to thirdembodiments.

In the following there will be explained, with reference to FIG. 15, thefunction of the present embodiment employing the accounting processmeans of the second embodiment and the apparatus therefor, in case auser L (receiving terminal 1403) requests an image Info 1 to a providerA (transmission terminal 1401) in a state where the image transmissionsystem has an available transmission capacity Cr (C13>Cr≧C12).

At first, in a first operation sequence [S1], the user L transmits, tothe provider A (transmission terminal 1401) through the transmissionpath, a message requesting the transmission of the image Info 1 (imagetransmission requesting message). The accounting process means 1404fetches this message from the receiving terminal 1403. Also when themessage is received by the transmission terminal 1401, the accountingprocess means 1402 thereof fetches the message from the transmissionterminal 1401.

Then, in a second operation sequence [S2], the accounting process means1402 inspects the traffic of the transmission path through thetransmission terminal 1401 to obtain the available transmission capacityCr, then compares the available transmission capacity Cr with C11 to C13by referring to the charge table shown in FIG. 6, thereby determiningthe transmission mode 2 for the transmission of the Info 1 and informsthe transmission terminal 1401 of such transmission mode 2.

Similarly the accounting process means 1404 determines the transmissionmode 2 and informs the receiving terminal 1403 of such mode.

Then, in a third operation sequence [S3], the transmission terminal 1401transmits the Info 1 through the transmission path to the receivingterminal 1403 in the transmission mode 2. The accounting process means1402 measures the amount of the information Info 1 transmitted by thetransmission terminal 1401.

The receiving terminal 1403 receives the Info 1, transmitted through thetransmission path. The accounting process means 1404 measures the amountof the information Info 1 received by the receiving terminal 1403.

Then, in a fourth operation sequence [S4], the accounting process means1402 monitors the Info 1 under transmission, and, upon confirming theend of transmission of the Info 1 to the user L either by detecting abit pattern indicating the end of the image or by receiving a messagefrom the transmission terminal 1401 indicating the end of transmissionof the Info 1 to the user L, reads the unit charge 12 from the chargetable shown in FIG. 6. It then calculates the charge to the user L,based on the unit charge 12 and the amount of information Info 1provided to the user L, and informs the transmission terminal 1401 ofsuch charge. Also the accounting process means 1404 monitors the Info 1under reception, and, upon confirming the end of reception of the Info 1from the provider A either by detecting a bit pattern indicating the endof the image or by receiving a message from the receiving terminal 1403indicating the end of reception of the Info 1 from the provider A, readsthe unit charge 12 from the charge table shown in FIG. 6.

It then calculates the charge, to be charged by the provider A, based onthe unit charge 12 and the amount of the information Info 1 receivedfrom the provider A, and informs the receiving terminal 1403 of suchcharge.

In a fifth operation sequence [S5], the charge payment is executed.

The following case is also included in the present embodiment.

At first, in the first operation sequence [S1], the user also designatesthe transmission mode, at the request of the image.

If the transmission capacity Cr enough for the transmission with thedesignated transmission mode cannot be obtained, the accounting processmeans 1402 (or 1404) effects transmission with the designatedtransmission mode and with the available transmission capacity Cr, orwaits until a sufficient transmission capacity is obtained, or effectstransmission with a transmission mode permitted within the transmissioncapacity Cr.

Otherwise it sends, to the image transmission apparatus (or imagereceiving apparatus in case of the accounting process means 1404), aninstruction for example of cancelling the request and effects anaccounting process corresponding to such instruction.

At the same time, the image transmission apparatus and the imagereceiving apparatus effect a process of image transmission or requestcancellation according to such instruction. The above-mentioned processoptions may also be asked to and selected by the user.

In another operation mode, at the first operation sequence, the useralso designates a terminal (or an image processing apparatus) as thedestination of the image, at the request for the image to the imageprovider, and the image provider A transmits the image information tothus designated destination. This operation includes following twocases.

In a first case, both the provider and the user are provided with theaccounting process means. In this case, the user (or the accountingprocess means thereof) receives a notice indicating the start of imagetransmission from the destination or the image provider, at the start ofimage providing prior to the third operation sequence, and initiates theaccounting process. Also in the fourth operation sequence, theaccounting operation is terminated in response to a notice indicatingthe end of image transmission. Also the amount of image information isinformed to the user from the destination or the image provider.

In a second case, the accounting process means are provided both at theprovider and the destination designated by the user. In this case, theuser sends, in the first operation sequence, the image transmissionrequesting message also to the destination, of which accounting processmeans fetches this message. The accounting process means of thedestination may inform the user of the charge in the fourth operationsequence [S4].

Also in the second operation sequence [S2], the accounting process means1402 reads the unit charge 12, and informs it to the transmissionterminal for display thereon for the provider A.

Also in the second operation sequence [S2], the accounting process means1404 reads the unit charge 13, and informs it to the receiving terminal1403 for display thereon for the user L.

In the third operation sequence, the accounting process means 1404 readsthe unit charge 12, then calculates the current charge based on the unitcharge 12 and the amount of the information Info 1 received up to suchtiming, and sends such charge to the receiving terminal 1403.

It is also possible to realize the accounting process means 1402 bymeans of the CPU, memory, storage device etc. provided in thetransmission terminal 1401, to realize the accounting process means 1404by means of the CPU, memory, storage device etc. provided in thereceiving terminal 1403, or to apply the accounting process means of thefirst or third embodiment.

The networks utilizing the accounting process means explained in theforegoing constitute embodiments of the present invention, but aparticularly preferred embodiment utilizing the accounting process meansof the present invention will be explained in the following.

Now a seventh embodiment of the present invention will be explained withreference to the attached drawings.

FIG. 16 is a block diagram showing the entire configuration of a networkof the present embodiment.

In FIG. 16 there is shown an ATM network 1601 for data transmission withan ATM (asynchronous transfer mode) to be explained later.

There are also shown local area networks (LAN) 1602, 1603, composed forexample of Ethernet, for data transfer in modes other than the ATM.These networks 1601, 1602, 1603 are connected to following variousapparatus.

There are shown a facsimile apparatus 1604, a color printer 1605provided therein with a page memory, a color copying apparatus 1606including a color scanner, a color printer, a page memory for storingthe original image data read by the color scanner, and a circuit forreading the image data from the page memory for supply to the colorprinter, a file server 1607 for temporarily storing the image dataentered through the ATM network, and a work station 1608 for datainput/output of the file server.

A terminal 1609 connected to the ATM network also effects data exchangewith the local area networks 1602, 1603 and effects various processingsuch as image data editing. The terminal 1609 is connected to theprinter 1605 etc. mentioned above, through the network 1603 or exclusivelines.

A server 1610, similar to the server 1607, is connected to a colorcopying apparatus 1611 which is similar to the color copying apparatus1606.

A digital television 1612, connected to the ATM network receives datatherethrough and displays such received data.

There are also shown a VCR 1613 receiving the image data through the ATMnetwork; a center station 1614 such as a CATV station for sendingvarious software data and image data to the ATM network; a first router1615 for connecting the ATM network to another ATM network; and a secondrouter 1616 for connection with another local area network.

Also unrepresented ATM network switches are provided between the ATMnetwork and the equipment connected thereto, such as the facsimileapparatus 1604, the printer 1605 and the color copying apparatus 1607.These equipment are provided, if necessary, with the accounting processmeans as shown in the foregoing first to third embodiments.

The accounting operation in the above-explained configuration will beexplained in the following with reference to FIG. 17, in case the centerstation 1614 is provided with the accounting process means (fourthembodiment) and the user terminal 1609 sends the request to thetransmission center station 1614, designating the digital television1612 as the destination of the image.

At first, in a first operation sequence [S1], the terminal 1609 sends arequest for transmission to the center station 1614, designating therequested image, the transmission mode therefor and the digitaltelevision 1612 as the destination. The accounting process means fetcheshis request from the center station 1614, which has received thisrequest.

Then, in a second operation sequence [S2], the center station 1614transmits the image data to the digital television 1612, which receivesthus transmitted data. In this sequence, the accounting operation isexecuted as explained in the foregoing fourth embodiment, whereby thecharge to be paid by the terminal 1609 (or the user thereof) to thecenter station 1614 is derived.

Then, in a third operation sequence [S3], if the terminal 1609 or thedigital television 1612 wishes to terminate the data reception in thecourse thereof, a request for terminating the transmission is sent tothe center station 1614.

Then, in a fourth operation sequence, in response to such request forterminating the transmission, the center station 1614 terminates thesupply of the image data. Detecting such termination, the accountingprocess means terminates the accounting operation.

Then, in a fifth operation sequence [S5], the center station 1614informs the terminal 1609 of the charge derived by the accountingprocess means.

In a sixth operation sequence [S6], the charge payment is executedbetween the center station 1614 and the terminal 1609. In case ofbidirectional data transfer, the accounting is similarly executed withthe inversion of the transmitting and receiving sides.

The present embodiment also includes the following cases.

In case the accounting process means is not provided in the centerstation 1614 but in the terminal 1609, in the first operation sequence[S1], the accounting process means fetches the request for transmissionfrom the terminal 1609.

Also at the start of image providing, a message therefor is transmittedfrom the center station 1614 or the digital television 1612 to theterminal 1609, and, at the end of the image providing, a messagetherefor is transmitted from the center station 1614 or the digitaltelevision 1612 to the terminal 1609.

Upon detecting the message indicating the start of image providing, theaccounting process means initiates the accounting operation as in thefourth embodiment, and, upon detecting the message indicating the end ofimage providing, terminates the accounting operation. In such case, thefifth operation sequence [S5] in this embodiment is omitted.

In case the accounting process means is not provided in the centerstation 1614 or the terminal 1609 but in the digital television 1612, inthe first operation sequence [S1], the accounting process means fetchesthe request for transmission from the digital television 1612.

The accounting operation is conducted as explained in the foregoingfifth embodiment, and, in the fifth operation sequence [S5] of thepresent embodiment, the charge is informed from the digital television1612 to the center station 1614 and/or the terminal 1609.

Also the function in case the accounting process means are provided atleast in both the center station 1614 and the terminal 1609 will beapparent from the sixth embodiment. It will thus be apparent that theaccounting on the data exchange can be achieved not only between thecenter station and the digital television but also among otherterminals.

In the following there will be explained an eighth embodiment of thepresent invention, with reference to the attached drawings.

FIG. 18 is a view showing an example of the multimedia network system inwhich the present invention is applicable, wherein shown are a B-ISDNnetwork 1801 utilizing high-speed public lines; a cable television(CATV) network 1802; local area networks (LAN) 1803, 1804; and acommunication satellite 1805.

There are also shown ground stations 1811, 1812 for effectinginformation communication through the communication satellite;information providers 1821, 1822 providing various multimediainformation including image and voice information through suchcommunication networks and receiving the charges therefor; and users1831 to 1839 utilizing the information provided from the informationproviders and paying the charges therefor.

The B-ISDN network 1801, the CATV network 1802, the LAN's 1803, 1804 andthe communication satellite 1805 are mutually connected to enable mutual(bidirectional) information exchange. The information providers 1821,1822 and the users 1831 to 1839 are respectively connected to thesecommunication networks. The information providers 1821, 1822 arerespectively provided with the accounting process means as shown in theforegoing first to third embodiments. However, since the bidirectionalcommunication is possible, the information provider may become a userand the user may become an information provider if the accountingprocess means are provided both in the information providers 1821, 1822and in the users 1831 to 1839. Also the above-mentioned accountingprocess means may be incorporated in each equipment, or provided betweeneach equipment and the network, or externally attached to eachequipment.

The function of the present embodiment will be explained in thefollowing, with reference to FIG. 19, in case the information providersalone are provided with the accounting process means, taking a case thatthe user 1839 requests the information from the provider 1821 and theprovider 1821 charges to the user 1839 according to the informationprovided thereto.

In the following description, the transmission path indicates the secondLAN 1804, the B-ISDN network 1801, the CATV network 1802 and the firstLAN 1803.

At first, in a first operation sequence [S1], the user 1839 sends arequest for the image transmission, to the information provider 1821through the transmission path.

Then, in a second operation sequence [S2], in response to the requestfrom the user 1839, the provider 1821 provides the user 1839 with theMPEG encoded image information through the transmission path. In thisoperation, there is executed the accounting operation as alreadyexplained in the fourth embodiment.

Then, in a third operation sequence [S3], the user 1839, if wishing tointerrupt the image transmission in the course thereof, sends a requestfor terminating the transmission.

In a fourth operation sequence [S4], in response to such request, theinformation provider terminates the image transmission. Also theaccounting process means terminates the accounting operation mentionedabove.

Then in a fifth operation sequence [S5], the charge payment is executed.In case the user is provided with the accounting process means is theabove-explained network, the function of the accounting process means isconducted according to the fifth embodiment. Also in case the providerand the user have the accounting process means, the function isconducted as in the sixth embodiment.

As will be apparent from the foregoing, the accounting to other users orother providers is similarly possible.

In the following there will be explained a ninth embodiment of thepresent invention.

In the transmission of information (image requesting signal, imageinformation, accounting information etc.) between a transmitting stationand a receiving station through a transmission path, there may resultillegal deeds such as:

1. Reception of the image information by a third party without chargepayment;

2. Request for and reception of the information by a third partypretending another receiving station;

3. Alteration of the charge-requesting information by the receivingstation, after the reception of the information; and

4. Forgery of the receipt information by the receiving station, withoutcharge payment.

As a countermeasure for such illegal deed, following cypher means may becombined with the accounting process means as shown in the first toeighth embodiments or the system utilizing the same.

In such case, in the configuration shown in FIG. 10, 12 or 14, thecypher means explained in the following may be provided on thetransmission terminal and the receiving terminal.

It is also possible to assign encypher/decyphering means to eachhierarchic layer of the image data and to include the operation time ofsuch encypher/decyphering means and the amount of image informationprocessed by the encypher/decyphering means in the charge calculation.

In the following there will be explained a tenth embodiment of thepresent invention. In contrast to the foregoing embodiments in which thenecessary frames alone are transmitted, the present embodiment transmitsall the frames of the MPEG data. The receiving side (user) only decodesthe necessary frames, and the accounting is conducted according to thusdecoded frames.

Consequently, in the present embodiment, the accounting process means isprincipally provided in the receiving side. In the present embodiment,the MPEG data decoding mode is defined as a mode 1 in case of decodingthe I-frame only, a mode 2 in case of decoding the I- and P-frames, anda mode 3 in case of decoding the I-, P- and B-frames.

The accounting means in the present embodiment is substantially same asthat in any of the foregoing embodiments, but is adapted to:

1) manage the above-mentioned decoding modes instead of the transmissionmodes; and

2) effect the accounting process by detecting the decoding mode, bymonitoring the decoding mode employed by the user for decoding the MPEGdata.

Also MPEG decoding means for decoding the MPEG data with a designateddecoding mode can be realized with a known MPEG decoding device. Thepresent embodiment also includes a case where the accounting means isprovided at the transmission side.

In the following there will be explained an eleventh embodiment of thepresent invention. In the transmission of information (image requestingsignal, image information, accounting information etc.) between atransmitting station and a receiving station through a transmissionpath, there may result illegal deeds such as:

1. Reception of the image information by a third party without chargepayment;

2. Request for and reception of the information by a third partypretending another receiving station;

3.Alteration of the charge-requesting information by the receivingstation, after the reception of the information; and

4. Forgery of the receipt information by the receiving station, withoutcharge payment.

As a countermeasure for such illegal deed, following cypher means may becombined with the accounting process means as shown in the first totenth embodiments. In such case, in the configuration shown in FIG. 12,14 or 16, the cypher means explained in the following may be provided inthe transmission terminal and the receiving terminal.

In the present embodiment, the MPEG data decoding mode is defined as amode 1 in case decoding the I-frame only, a mode 2 in case of decodingthe I- and P-frames, and a mode 3 in case of decoding the I-, P- andB-frames.

In particular the present embodiment, utilizing the foregoing first totenth embodiment, is capable not only of encyphering the MPEG data fortransmission but also of realizing the following accounting system.

At first, as shown in FIG. 22, the transmitting side encyphers theI-frame with a cypher key Ki, the P-frame with a key Kp and the B-framewith a key Kb.

In case the user (or the terminal thereof) wishes the mode 1, thetransmitting side informs the user of the key Ki or a decyphering keycorresponding thereto.

In case the user wishes the mode 2, the transmitting side informs theuser of the keys Ki and Kp or decyphering keys corresponding thereto.

In case the user wishes the mode 3, the transmitting side informs theuser of the keys Ki and Kp and Kb, or decyphering keys correspondingthereto, and then the encyphered MPEG data are transmitted. In thisoperation, the transmitting side executes an accounting processcorresponding to the decyphering keys informed to the user.

The present embodiment also includes a case in which the amount ofinformation subjected to the decyphered operation, the number ofencyphering or decyphering operations, the operation time of theencyphering or decyphering means etc. are reflected on the charge.

Also in order to always inform only one key to the user, for the userwishing the mode 1, the transmitting side encyphers the I-frame with acypher key K1 and the I- and P-frames with a key K2 and informs the userof the key K1 or a decyphering key corresponding thereto.

Also for the user wishing the mode 2, the transmitting side encyphersthe I- and P-frames with a key K1 and the B-frame with a key K2, andinforms the user of the key K1 or a decyphering key correspondingthereto. For the user wishing the mode 3, the transmitting sideencyphers the I-, P- and B-frames with a key K and informs the user ofthe key K or a decyphering key corresponding thereto. Such operationmode is also included in the present embodiment.

The cypher technology can be generally classified into a common keycypher system and an open key cypher system to be explained in thefollowing.

In the common key cypher system, a same cypher key is secretly owned bythe transmitter and the receiver (also called secret key cypher system,symmetrical cypher system etc.).

The common key cypher system can be classified into a block cypher inwhich the encyphering is executed with a same key for every block ofcharacters of a suitable length, and a stream cypher in which the key ischanged for every block of characters or for every bit. In theabove-mentioned block cypher, there are known a mutation cypher in whichthe encyphering is achieved by mutating the order of characters, and areplacement cypher in which each character is replaced by anothercharacter.

In these cypher systems, a correspondence table for mutation orreplacement constitutes the cypher key.

In the stream cypher, there are known Visinel code employing multipletables, and Vernum code employing a key used only once. (Details ofthese cypher systems are described by Ikeno and Oyama, “Modern cyphertheory”, Electronic Information Communication Association, 1986,Chapters 2 and 4.)

Among the block cypher systems, some systems of which algorithms arealready disclosed, such as DES (Data Encryption Standard) or FEAL (Fastdata Encipherment Algorithm) are widely used as the commercial cyphersystems. (For details, see Tsujii, Kasahara, “Cypher and informationsecurity”, Shokodo, 1990, Chapter 2.)

The open key cypher system employs an encyphering key and a decypheringkey which are mutually different, wherein the encyphering key is madeopen but the decyphering key is kept secret. Such open key cypher systemis featured by:

1) As the encyphering key is different from the decyphering key and canbe made open, the delivery of the key is made easy;

2) As the encyphering key of each user is made open, each user is onlyrequired to keep the decyphering key secret; and

3) There can be realized a confirming function, for the receiver toconfirm that the transmitter of the transmitted text is true and thatthe transmitted text has not been altered. Such function is also calleddigital signature, for which there have already proposed varioussystems, such as RSA code, R code, W code, MI code, MH code, GS code, CRcode, M code, E code, T code, S code, L code, GMY code, GMR code, OSScode and OS code. (for details, see Ikeno, Oyama, “Modern CypherTheory”, Electronic Information Communication Association, 1986,Chapters 5 to 8.)

The foregoing embodiments, setting the frame of the MPEG data accordingto the traffic of the transmission path and calculating the charge forthe image according to the content of thus set frame, can realize anaccounting system exploiting the kind and quality of the information andthe service, thereby being adaptable to various information andservices.

Also according to another feature, the accounting process can beexecuted with a charge system in consideration of the amount of imageinformation, in addition to the content of the transmitted frame.

Also according to sill another feature, the accounting can be executedcorresponding to the hierarchic encoding technology.

What is claimed is:
 1. A transmission system having a transmissionterminal for transmitting data, receiving terminals for receiving thedata, and a transmission path for connecting the transmission terminaland the receiving terminals, comprising: designating means which isprovided in said receiving terminal, for designating a transmission modeof the data to be transmitted via the transmission path; detecting meanswhich is provided in said transmission terminal, for detecting trafficin said transmission path; determining means for, in accordance with adetection result, determining whether or not a transmission using thedesignated transmission mode is possible; and changing means for, inaccordance with the determination result, changing the designatedtransmission mode to an executed transmission mode for transmitting thedata in the transmission path; and accounting means for accounting inaccordance with the executed transmission mode.
 2. A transmission systemaccording to claim 1, wherein said transmission path includes an ATMtransmission path.
 3. A transmission system having a transmissionterminal for transmitting data, receiving terminals for receiving thedata, and a transmission path for connecting the transmission terminaland the receiving terminals, comprising: designating means which isprovided in said receiving terminal, for designating a transmission modeof the data; detecting means which is provided in said transmissionterminal, for detecting traffic in said transmission path; determiningmeans for, in accordance with the detection result, determining whetheror not a transmission in the transmission mode designated by saiddesignating means is possible; and accounting means for accounting inaccordance with the designated mode in case of executing thetransmission, wherein said transmission mode designates various framesof MPEG as transmission data.
 4. A transmission system according toclaim 3, wherein said various frames include an I-frame, P-frame andB-frame.
 5. A data transmission method for transmitting data via atransmission path, the method comprising: (a) a step of receiving arequest for data; (b) a step of setting a transmission mode of the datato be transmitted via the transmission path in accordance with trafficon the transmission path; (c) a step of transmitting the data in the settransmission mode via the transmission path; and (d) a step of settingan accounting mode in accordance with the data and the transmissionmode, and accounting based on the accounting mode.
 6. A datatransmission method comprising: (a) a step of receiving a request fordata; (b) a step of setting a transmission mode in accordance withtraffic on a transmission path; (c) a step of transmitting the data inthe set transmission mode; and (d) a step of setting an accounting modein accordance with the data and the transmission mode, and accountingbased on the accounting mode, wherein the transmission mode designatesvarious frames of MPEG as transmission data.
 7. A computer readablemedium storing a program of a data transmission method for transmittingdata via a transmission path, the method comprising: (a) a step ofreceiving a request for data; (b) a step of setting a transmission modeof the data to be transmitted via the transmission path in accordancewith traffic on the transmission path; (c) a step of transmitting thedata in the set transmission mode via the transmission path; and (d) astep of setting an accounting mode in accordance with the data and thetransmission mode, and accounting based on the accounting mode.
 8. Atransmission method for a system having a transmission terminal fortransmitting data, receiving terminals for receiving the data, and atransmission path for connecting the transmission terminal and thereceiving terminals, the method comprising the steps of: designating, insaid receiving terminal, a transmission mode of the data to betransmitted via the transmission path; detecting, in said transmissionterminal, traffic in said transmission path; determining, in accordancewith a detection result, whether or not a transmission using thedesignated transmission mode is possible; and changing, in accordancewith the determination result, the designated transmission mode to anexecuted transmission mode for transmitting the data in the transmissionpath; and accounting in accordance with the executed transmission mode.9. A computer readable medium storing a program for performing atransmission method in a system having a transmission terminal fortransmitting data, receiving terminals for receiving the data, and atransmission path for connecting the transmission terminal and thereceiving terminals, the method comprising the steps of: designating, insaid receiving terminal, a transmission mode of the data to betransmitted via the transmission path; detecting, in said transmissionterminal, traffic in said transmission path; determining, in accordancewith a detection result, whether or not a transmission using thedesignated transmission mode is possible; and changing, in accordancewith the determination result, the designated transmission mode to anexecuted transmission mode for transmitting the data in the transmissionpath; and accounting in accordance with the executed transmission mode.